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visual  display  more  quickly  when  it  is  encountered  for  a  second  time.  The  project  addresses  three  fundamental  properties  about  spatial 
learning.  First,  does  learning  have  a  capacity  limit?  Second,  is  learning  reduced  when  attention  is  tied  up  by  a  secondary  load?  Third,  how 
much  does  the  learning  ability  vary  across  individuals,  and  what  are  the  cognitive  and  brain  mechanisms  that  separate  good  learners  from 
poor  learners?  We  found  that  spatial  context  learning  is  automatic,  flexible,  has  high  capacity,  and  applies  to  most  individuals.  This 
mechanism  can  potentially  overcome  cognitive  limitations  in  human  attention  and  working  memory,  and  may  assist  soldiers  in  spatial 
navigation. 
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1.  Foreword 

This  three-year  project  funded  by  the  Army  Research  Office  aims  to  explore  cognitive  mechanisms 
that  allow  us  to  overcome  limitations  in  attention  and  working  memory.  It  focuses  on  implicit  learning 
of  repeated  spatial  context.  The  results  are  promising  in  showing  that  this  kind  of  learning  occurs  even 
when  attention  is  directed  elsewhere  or  when  the  spatial  task  is  conducted  under  heavy  secondary  task 
load.  The  spatial  context  learning  mechanism  may  potentially  aid  soldiers  in  spatial  navigation. 

2.  L  ist  of  Appen  dix 

All  published  articles  can  be  downloaded  in  their  pdf  format  from  the  Pi’s  laboratory  webpage  at: 
http://iianglab.psych.umn.edu.  Requests  for  reprints  can  be  sent  to  Y.V Jiang:  jiangl66@umn.edu. 

3.  Statement  of  the  problem  studied 

Humans  process  a  visual  display  more  efficiently  when  they  encounter  it  for  a  second  time.  In 
visual  search,  for  example,  observers  are  faster  at  detecting  a  target  when  the  same  search  display  is 
occasionally  repeated,  even  though  they  are  unaware  of  the  repetition.  Such  learning  is  implicit, 
existing  without  observers’  conscious  awareness.  The  project  supported  by  the  Army  Research  Office 
aims  to  address  three  fundamental  properties  about  spatial  context  learning.  (1)  Does  learning  have  a 
capacity  limit?  (2)  Is  it  reduced  when  attention  is  tied  up  by  a  secondary  task?  (3)  How  much  does  the 
learning  ability  vary  across  individuals,  and  what  are  the  cognitive  and  brain  mechanisms  that  separate 
good  learners  from  poor  learners?  In  a  series  of  9  published  studies  and  other  conference  reports,  we 
found  that  spatial  context  learning  is  automatic,  flexible,  has  high  capacity,  and  applies  to  most 
individuals.  This  mechanism  can  potentially  overcome  cognitive  limitations  in  human  attention  and 
working  memory,  and  may  assist  soldiers  in  spatial  navigation. 

4.  Summary  of  the  most  important  results 
(1)  Visual  implicit  learning:  Guidance  of  attention  by  learning 

Humans  process  a  visual  display  more  efficiently  when  they  encounter  it  for  a  second  time.  A 
previously  perceived  object,  now  presented  briefly,  is  correctly  identified  more  accurately  than  a  new 
object,  showing  priming  (Tulving  &  Schacter,  1990).  Such  perceptual  facilitation  is  seen  not  only  for 
isolated  shapes  or  words,  but  also  for  complex  visual  displays  (Chun  &  Jiang,  1998,  1999).  When 
conducting  visual  search  for  a  T  target  among  L  distractors,  observers  are  faster  at  detecting  the  target 
when  the  same  display  is  occasionally  repeated  (Chun  &  Jiang,  1998;  Y.  Jiang  &  J.  H.  Song,  2005;  Y. 
H.  Jiang  &  J.  H.  Song,  2005),  even  when  observers  are  unaware  of  such  repetition  (Chun  &  Jiang, 
2003).  Implicit  learning  of  repeated  visual  display  allows  attention  to  be  deployed  to  target  regions 
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defined  by  past  experience.  Such  contextual  learning  is  fast,  with  an  effect  appearing  after  only  five  or 
six  repetitions;  it  is  strong,  preserved  even  when  only  half  of  the  items  are  repeated  (Song  &  Jiang, 
2005);  it  is  powerful,  allowing  at  least  60  repeated  displays  to  be  learned  (Y.  H.  Jiang,  Song,  &  Rigas, 
2005);  and  it  is  robust,  persisting  for  at  least  a  week  (Chun  &  Jiang,  2003;  Y.  H.  Jiang  et  ah,  2005).  It 
may  compensate  for  our  limitations  in  moment-to-moment  attentional  capacity. 

(2)  Attention  and  implicit  learning 

The  role  of  attention  in  perception  and  memory  is  one  of  the  longest  standing  debates  in  human 
cognition.  Extensive  evidence  suggests  that  conscious  perception  and  explicit  memory  depend  on 
attention:  Unattended  information  is  often  not  perceived  or  remembered.  But  does  implicit  learning  of 
complex  visual  displays  depend  on  attention?  To  address  this  issue,  we  tested  observers  in  a  visual 
search  task  where  they  searched  for  a  white  T  among  black  and  white  Ls.  When  the  locations  of  the 
target  and  the  attended  set  (white  Ls)  were  repeated,  search  speed  was  enhanced;  but  when  the 
locations  of  the  target  and  the  ignored  set  (black  Ls)  were  repeated,  search  speed  was  unaffected.  This 
suggests  that  the  expression  of  learning  depends  on  attention  (Y.  H.  Jiang  &  Chun,  2001).  However, 
during  a  transfer  test,  when  the  previously  ignored  set  now  was  attended,  it  immediately  facilitated 
performance.  In  contrast,  when  the  previously  attended  set  now  was  ignored,  it  no  longer  enhanced 
search  speed  (Y.  H.  Jiang  &  Leung,  2005).  Thus,  the  expression  of  visual  implicit  learning  depends  on 
attention  but  latent  learning  of  repeated  information  does  not. 

How  much  attention  is  needed  for  implicit  learning  to  be  expressed  in  behavior?  Previous 
studies  have  found  inconsistent  results,  with  some  implicit  learning  tasks  requiring  virtually  no 
attention  while  others  rely  on  attention.  In  one  study  we  examined  the  degree  of  attentional 
dependency  in  implicit  learning  of  repeated  visual  search  context  (Rausei,  Makovski,  &  Jiang,  in 
press).  Observers  searched  for  a  target  among  distractors  that  were  either  highly  similar  to  the  target  or 
dissimilar  to  the  target.  We  found  that  the  size  of  learning  was  comparable  from  repetition  of  the  two 
types  of  distractors,  even  though  attention  dwelled  much  longer  on  distractors  highly  similar  to  the 
target.  We  suggest  that  beyond  a  minimal  amount,  further  increase  in  attentional  dwell  time  does  not 
contribute  significantly  to  implicit  learning  of  repeated  search  context. 

(3)  Spatial  context  learning  under  heavy  attentional  load 

Images  of  natural  scenes  are  staggeringly  complex,  and  in  many  respects  our  ability  to  extract 
and  remember  visual  details  is  extremely  limited  (Rensink,  2002;  Simons  &  Levin,  1998). 
Nevertheless,  humans  are  capable  of  coping  with  this  computational  difficulty  in  the  real  world  and 
navigate  their  surroundings  without  major  problems.  Two  mechanisms  are  essential  to  overcoming  the 
complexity  of  visual  input:  Implicit  learning  and  visual  attention.  Is  implicit  learning  reduced  or 
eliminated  by  secondary  tasks  that  load  up  attention?  To  find  out,  we  tested  observers  in  a  dual-task 
condition  where  they  divided  attention  between  spatial  context  learning  and  a  secondary  task  that 
heavily  loaded  up  visual  working  memory.  Our  results  found  that  divided  attention  does  not 
significantly  weaken  spatial  context  learning  (Vickery,  Sussman,  &  Jiang,  submitted).  Spatial  context 
learning  was  observed  independent  of  whether  learning  was  carried  out  as  a  single  task  or  under  heavy, 
secondary  load  tasks.  These  results  show  that  learning  of  repeated  visual  context  is  relatively 
insensitive  to  attention.  They  support  the  general  theoretical  framework  that  divides  explicit  from 
implicit  processes,  with  the  latter  being  more  robust  to  many  stressors,  including  the  availability  of 
attention  and  working  memory  resources  (Reber,  1989). 
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(4)  Individual  differences  in  spatial  context  learning 

Given  its  potential  importance  in  vision,  spatial  context  learning  may  be  a  mechanism  that 
every  individual  within  the  normal  population  is  capable  of.  In  fact,  the  degree  of  individual 
differences  is  generally  narrower  for  implicit  processes  than  explicit  processes.  Yet  in  our  own 
research  we  often  failed  to  see  learning  in  a  small  subset  of  participants,  approximately  20%,  see  also 
(Lleras  &  Von  Muhlenen,  2004).  Such  variability  is  puzzling  given  that  implicit  learning  is  considered 
a  stable  ability  across  a  variety  of  population  groups.  To  study  individual  differences,  we  tested 
another  group  of  individuals  on  spatial  context  learning  and  other  tasks  and  correlated  the  size  of 
learning  with  other  abilities  of  the  individual.  Our  results  failed  to  show  significant  correlations 
between  spatial  context  learning  and  performance  in  other  tasks,  such  as  mental  rotation  and  visual 
working  memory  (Y.  V.  Jiang,  King,  Shim,  &  Vickery,  2006).  In  another  study,  we  tested  a  group  of 
individuals  on  spatial  context  learning  across  five  sessions.  We  measured  the  size  of  learning  in  each 
session  for  each  individual  and  rank  ordered  an  individual’s  placement  in  the  group  for  each  session. 
The  rank  order  was  highly  inconsistent:  Individuals  who  ranked  high  in  one  session  did  not  necessarily 
rank  high  in  another  session.  The  correlation  across  sessions  was  not  significantly  different  from  zero 
(Y.  H.  Jiang  et  ah,  2005).  An  individual  who  does  not  show  learning  in  one  testing  session  is  not 
necessarily  someone  who  cannot  learn  from  repeated  spatial  context.  If  tested  again,  that  individual 
may  show  as  much  learning  as  other  participants  do.  Indeed,  a  person  who  fails  to  show  learning  in  one 
session  may  nonetheless  show  it  a  week  later,  even  when  no  new  training  session  was  involved  (Y.  H. 
Jiang  et  ah,  2005).  Thus,  the  potential  to  learn  from  repeated  spatial  context  most  likely  exists  in  every 
normal  adult,  but  whether  learning  is  revealed  in  a  given  testing  session  may  depend  on  other 
experimental  factors,  such  as  the  mode  of  attention,  task  difficulty,  and  display  complexity. 

(5)  Brain  mechanisms  for  spatial  context  learning 

What  is  the  neural  basis  of  spatial  context  learning?  To  address  this  question,  we  used 
functional  Magnetic  Resonance  Imaging  (fMRI)  to  scan  normal  adults  in  a  spatial  context-learning 
task.  On  each  trial  observers  viewed  a  circular  array  of  16  elements,  one  of  which  was  a  letter  T  rotated 
to  the  left  or  to  the  right.  The  elements  were  presented  against  a  natural  scene  background.  In  the  old 
condition,  the  background  scene  was  repeated  across  blocks  and  the  target  T  was  always  in  the  same 
position  against  the  scene.  In  the  new  condition,  neither  the  background  scene  nor  the  target  location 
was  repeated.  Finally,  in  the  shuffled  condition,  the  background  scene  was  repeatedly  presented,  but 
the  target  location  could  be  at  any  of  the  16  locations  randomly  determined.  By  comparing  the  three 
conditions,  it  was  possible  to  separate  associative  learning  from  scene  familiarity  (Y.  V.  Jiang  et  ah, 
2006).  Brain  imaging  data  showed  that  parahippocampal  place  area  and  superior  parietal  lobule  were 
both  more  active  when  participants  searched  from  novel  displays  than  from  repeated,  old  displays. 
Furthermore,  the  parahippocampal  place  area  was  affected  primarily  by  perceptual  familiarity,  but  not 
by  associative  learning,  as  its  activity  was  higher  in  the  new  condition  than  the  old  or  shuffled 
conditions,  but  equally  low  in  the  latter  two  conditions.  In  contrast,  the  superior  parietal  lobule  showed 
reduced  activation  in  the  old  condition  compared  with  the  other  conditions,  suggesting  that  this  brain 
region  was  sensitive  to  associative  learning  but  not  to  perceptual  familiarity.  This  study  is  one  of  the 
first  to  use  neuroimaging  to  study  spatial  context  learning.  In  combination  with  individual  difference 
studies,  this  study  can  potentially  assist  the  selection  of  soldiers,  enhance  the  design  of  human-machine 
interface,  and  aid  the  selection  of  suitable  aircraft  or  security  personnel. 

(6)  Learning  from  interrupted  visual  searches 
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Imagine  that  a  soldier  is  driving  down  a  road,  searching  for  a  particular  street,  when  suddenly  a 
boy  runs  in  front  of  his  car  and  causes  him  to  slam  on  the  brakes.  After  the  incident,  he  resumes  his 
search  for  the  street,  but  would  he  be  able  to  use  memory  from  his  initial  search  attempt  to  aid  search 
on  resumption?  Previous  studies  on  visual  search  have  not  addressed  this  question  directly,  nor  have 
they  provided  a  conclusive  answer.  In  a  recent  study,  we  investigated  the  nature  of  memory  from 
ongoing  but  interrupted  searches  and  its  availability  for  search  on  resumption  (Shen  &  Jiang,  2006). 
Participants  conducted  a  change  detection  search  task  on  polygons  overlaid  on  scenes.  Search  was 
interrupted  by  various  disruptions,  including  unfilled  delay,  passive  viewing  of  other  scenes,  and 
additional  search  on  new  displays.  Results  showed  that  performance  was  unaffected  by  short  intervals 
of  unfilled  delay  or  passive  viewing,  but  it  was  impaired  by  additional  search  tasks.  Across  delays, 
memory  for  the  spatial  layout  of  the  polygons  was  retained  for  future  use,  but  memory  for  polygon 
shapes,  background  scenes,  and  absolute  item  location  was  not.  We  suggest  that  spatial  memory  aids 
interrupted  visual  searches,  but  the  use  of  this  memory  is  easily  disrupted  by  additional  searches. 
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